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An Al gorithmic. Approach to Curriculum Constructions 
Development, Computer Implementation, and Evaluation of a Method 
for Identi f ying Instruct iona 1 Content Sequences 

W a 1 1 a c e H • Wu 1 f e c k 1 1 
' NAVY PE^^SONNEL RESEARCH and DEVELOPMENT CENTER . 

San' Diego, CA 92152 ' 

Jntroducti on > 

This paper describes an investigation, based on the Struc- 
tural Learning Theory (Scandura,. 1973; in press), of problem, 
sequencing. The first step involved analyzing a set of problems, 
to determine the knowledge (rules) required for solving the prob- 
lems. Here, a set of sample problem's, (geometric .construction 
problems in. this study) was analyzed using a method (Scandura, . 
Diirnin, and Wulfeck, 1974) forvderivinq and simplifying rul^s 'or 
al gDr.i thms f or solving the problems. Next, assumptions were 
adopted from the Structural Learning Theof'y concerning how sub- 
jects "learn- — and — appiy -rule s-to-s'olve- problems. • A computer was . 
programmed according to these . assumptions , and given some of tj\e 
simplified rules identified during the previous step, in order to ^ 
simulate, some aspects of subjects'' jDroblem solving and learning. 
Various problem sequences wtgre then given to the .prociram, to 
identify tK'o'se that were solvable and learnable • " Finally, for 
initial evaluation of Jbhe approach, sequences which were learn- 
able for the program were given to subjects, whose, performance, 
was compared with the performance of. -subjects given random or 
learner-controlled sequences. ' . 

A nalysis Qsaoiiiriii QaQ^lLuction Erntiiams. • 

Scandura, Durnin,'^and Wulf eck , . ( I 974) developed a quasi- 
systematic method for constructing sets of rules underlying suc- 
cessful solutions for problems. *2-i Briefly, it involves^ (.1) 
sampling and classifyin g problems to be' analyzed iato* groups of 



• This paper is based on isections of the author ^s . disser- 
tation (Wulfeck,. 1975) conducted under the chairmanship of Dr. J. 
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*2. Theoretical foundations under lying the method of 
analysis are given in Scandura (1973, Chap. 5). 
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similar problems; (2) specifying rule'for solving each< 'Classi 
fied problem; (3) identifying lower order. ( component ) ru les which"^ 
may be operated upon (e^g. concatenated) to form, the solution"^^ 
rules identified in step 2, and, more important ly/ identifyina. 
higher order rules which op.erate. on. the lower order . rules to oeh-i 
erate the solution rules; (4) eliminating the solution rules made 
unnecessary by the introduction of the lower and higher order 
rules; and '( 3) testing and) refining the resulting set of rules so 
that solution rules for all the orioinally grouped problems,* and 
new problems from the same groups, can be generated. Requiring 
that the resulting set of rules account for problem* solutions in 
this, vyay makes the .analv^^sis "self-validating. " 

To i llustrate the method of analysis, consider the foll'qwihg 
two geometric construction tasks 5 

(1.) ''Given point P, Line . L, and Distance C:onstruct a 

circle with radius D, passing tkirouqh.P, tangent to L. " ' 

(2.) *-Giveh triangle ABC, construct ( circumscribe ) a circle 
passing through points A, B, and C. '* 

After specifying solution rules . for these tasks ,- and others , 
lower order rihle^s involved in-generating the solutions were iden- 
tified: ■ . ' ' 

Hil s Construct a circle with a given point as center, aatf^, a 
given distance as radius. (p, d) ==HI=> c(p, d) »^ 

R2s Construct a line parallel to a given line at a given 
distance from the given line. (1, d) ==R2=> IIJC.I, d) 

R3s Construct the locus\of points (a line) equidistant from 
two given points. (p, p^ ). ==H3=> ll(p, p^) - ■' ' 

R4s Construct a circle with a given point as center, pass- 
ing throuah another aiven poiiit. (p, p'') .==R4=> c(p, d(p. 

From commonalities among solution rules for tasks (.1). and 
.(2) above, and others, Scandura, Durnin, and Wulfeck (1974) iden- 
tified a . "two-loci ** higher order rule which could operate on 
rules like HI - R4 above to yield ■ solution rules for tasks (1.) 
and (2n). The higher order rule, essentiallyv concatenates rules 
f or _ constructin g two different loci, then a rule for constructing 
the* "goal fi gure'* from an intersection point (px^"* of t^e loci. 
For tasks (1) and (2), the output r u les are [ R I ( p , d), R2(l, d), 
Rl(px, d)]., and [R3(a, b), R3{o, c), R4(bx, a)]. 

Rule RI above is "basi c** enough . so that it need not be 
further analyzed. However, the others (including the higher 
"cnrderi — rul-e-) — ri=rn— hf^-H'-H-H'-h-^r- r i n n 1 y? ^^^^ thp s^^n e m et, hp, d . For 

■example, rules R2 and R3y v/hen re-analyzed, were found to be 



generable from the following lower order rules: 

. R5« Construct a point , at a given distance from a given 
line . ' ' . ■ 

R6s Construct a . point equidistant from two given points. 

R7« Construct a line through* two given points. 

A higher order rule which concatenates two. rules for constructlna 
points satisfying the same condition a required line must, 
satisfy, then a rule for constructing the "gba] figure" (the 
line) can opBra'te on rules R5 - R7 to yield rules R2 and. R3 as 
outputs. \ 

The two higher order rules discussed ' above can also .be 
further analyzed. Both of them involve 'concatenating two rules 
v/hich yield separate elements, then reconcatenatin g a rule which 
operates on the separate elements to yield a "goal figure'* (see 
Wulfeck, 1975, for details of the /analysi s with respect to higher, 
order rules) . - In ef fev:t , higher order rules can themselves be 
concatenated using a'' higher order/ concatenation rules. 

■ ■ . ■ ■ - • ^ y- _ ^_ 

In extending the geometr i c construct ion anayjses, the method 
of analysis described above was 'reapplied yrecurs'ively" ' as illus- 
trated. Analysis continued until rule's pe^formable by seventh- 
grade students .w;efe reached. The basic ryiles identified included 
lower-order rulfe^\f or constructing a circyle given the center and^ 
radius, drawing a 1 ine or segment througl/i two given .points, find- 
ing a point of intersection of / intersecting lines or circles, 
measuring (setting* a -compass to) tj?ie di stance betv/een giVen 
points, and choosin g arbitrary points oyr "r distai:^cei5. .. The .basic 
higher order rules included Vcompos^it^'on" (concatenate -two rules 
when the^output of one is a required i^nput oif the. second), and 
"con junction" (cbmbine two / rules yielding individual elements, 
into a sin gle rule for constructing t^vo . el^ 

* • ' ■ . ■ • ' / ■ ' ' . " ■ ■ ' 

At this point, it ml ght . appear jfchat to .deprive ' sequences,, one 

need only trace backward through. t!he analysis which yielded the 

basic set. However, this strategy/ is insufficient since (a) 

there are -other sequences than the/ reverse of the order in which 

problems Were/ cons idered, and (b|f there are sequeaces^ which 

include * prpKlems^. not even co^hsider^d" during the . original. 

analysis, but^sol-vabie via the Id^intified Yules. In general, the 

competence -analysis does not , yield a strict hierarchy from which 

itxis possible to. "read" performatole sequences. Fur^'hermore, and. 

©ost; important , . dne cannot make predictions about ^problem solving 

and learning with * respecf to / task sequences,/ without . making 

(expli)cit or impli cit ) ass.umpt:^'ons about humajy'^learning and pier- 

formance. ^ " / , / 



CortiDuter I mple me ntation' . 

This approach to sequence investigation f therefore, depended 
upon' adoptibn of explicit assumptions concerning sub jects^ appli- 
cation' and acquii,ition of rules in problem solving situations. 
The simplest of ^sisveral possible- rule control mechanisms (sets of 
prpblem solving and learning assumptions) proposed by . Scandura 
('1973)' was adopted h^e, and implemented as a computer ' program .to 
aid in sequencie development. 

' ' ■ . " • ■ * ■ ■ . . ' . • 

It is ass'umed that the. mechanism is goal directed, and that 
problems are first uniformly and correctly interpreted' ( as a pair 
consisting of given information [SJ, and a -unitary goal [GJ, not 
a series of subgoals)«*3 



INSERT FIGURE 1 ABOUT HERE..- 



Briefly, the program works as shown in Figure 1: (I) Given a 
problem situation <S, G> for which qt least one "applicable"- rule 
is , available (in the set of rules available to the program) , one 

of ' the se._Js _a pp.1 led to S_..to_^satJsf y_ G. In . the program, appli caj;^ 

bility decisions are made by "matching" specifications of rule 
ranges and domains aga.inst G and S. . (2) Given a goal situation 
for which- no appliable.: rules are aval lable , then control shifts 
to the higher level goal H( G) of der i vln g a rule applicable to 
the previous .goal. . (3) Given that H(.G) is. 'satisfied, then any 
deri'ved rule is added to the set of available rules, ^and control 
reverts to the previous goal Mf^- G /. - " 

These control assumptions ,are intentionally neutral with 
respect to. other .litni tat ions on human information processing 
capacity, memory, etc. That is ^ the program is .built to work 
perfectly with respect to applicability determination, rule exe- 
cution, access of the rule set, etc. Under these assumptions, 
the program is an idealized: problem, solver; human subjects, of 
course, are not. To limit the program^s performance for Simula-- 
tion .purposes (in . the absence of more formal- limiting assump- 
tions), a goal limit (GLIMIT.in Figure I.) is imposed which' con- 
trols the hi chest, level goal, per problem, the mechanism is 
allowed, to attempt. *4 . 



*3. In the Structural^Learning Theory,, it is assumed that a 
presented problem is aciopted as a pair of ordered subcoals, " in- 
terpret/the problem" .(determine its meaning), and. ."solve the in- 
terpreted problem." While this paper is corrcerned. with the second 
of th§se., no essential changes in methods or approach appear 
necessary to treat the first (see. Scandura, 1973; in press). 
Some directions in investigating interpVetation of Geometric con-~ 
struction problems are given in Wulfeck (1975). . ' 



The overall across-problem operation of ^ the program is 
detailed . in Figure 2. (This part of the program is concerneid 
with problem "book-keeping" and' i s -outsid.e' the theory. ) - 
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The program is initially given a set of basic rules; this is the 
only part of the program specific to 'the particular content - 
domain. When the program is given a list of problemis to ..solve, 
it. attempts problems in turn, di scardin g. solved problems but 
Adding rules derived during those solutions to' its rule set. - 
Failed problems are retained on . a. list, arid are later re- 
attempted.' This continues until .all problems are solved (or 
until the number of failed problems reaches, some prespecified 
failure limit). This process "has the effect of re-ordering 
presented problems into a sequence in which each problem is .solv- 
able according to control assumptioris and the goal limit con- ^ 
straint on its first presentation.- The program outputs may then' 
be used to. discard redundant problems, to rearrange problems, or^^ 
t'o add Intermediate problems so that some unsolved problem(s) may\^j 
become solvable./ 

The highest level goal at., which a problem becomes' solvable 
by the program (before g^al reversion)' seems to provide a natural, 
measure of the "step size" or " difficult y.^Hrey*eT^»^.-^ .(between) 
sequenced problems. For example, problems for which a solution' - 
rule already exists in tKe current rule set, .. are solvable at the 
initial go^l ievel-(CG\= I in Figure 1): .Problemi?: whose solution 
rules are derivable from. rules in the set via a higher order rule : 
in the set are 'solvable at the second goal level (CG = 2) , etc. 
This . step size measure "summarizes (but is not perfectly* or 
linearly related to) both the amount of processing problem solu- . 
tions entail, and the_numbex of rules involved in generating 
problem solutions. "::^The central point* is that there is no fixed a 
priori step size for any problem;, the step size is always rela- 
tive to the knowledge base- — the rule set^—existing at the time a 
problem is presented. When the. goal limit (GLIMIT in Figure I) 
is set to some number N, this restricts the output sequences of 
the program to those 4n which every prdblem is solvable at.. CG < 
N; sequenced problems are thus restricted to some maximum step 
-size or level of difficulty. 



*4. Extensions of the mechanism, desicned to deal with 
memory processes, processirig capacity, and other capabilities . df 
subjects are available in the Structural Learning Theory. See 
Scandura( 1973, in pressl. ' 
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According too the above discussion,, we expect that with human 
subjects, both failure frequencies and solution latencies are 
related to increasing step size. Then, sequences in which step 
sizes, are kept small should lead to better overall performance 
than those ^in which step size* is uncontrolled. 

Four groups ( ten sevepthrgrade ' subjects each) were given 
different sequence arrangements of. 'geometric construction tasks: 
Group XI received a sequence of 20 problems devised, using the 
program, , so that the step size for problems 18 and 20 was three, 
for all others, two. Grqup X2 received a sequence obtained from 
the . first by deleting four problems. According to the prograra^s 
performance, this increased the step sizes for problems 9 and 13 
to three, and decreased the y;tep c;i7e .for problem 1 8 to ; two . "(The 
higher order rule for problem 9 derived at CO = 3 was usable " on 
problem 18^. ; Group R was- given the original 20 problems'* but 
after problem 6, problem order was random. Subjects in group L, 
after problem 6, were allowed. to choose each problem to attempt 
next .*5 ' . 

Results .and' Discussion. . ' . 

Means -6f~subjects^^percent success on prob lems . attemp1;ed 

after problem 6 were: grpup Xl, 85%? X2, 73%; L, 47^rr"ancrRT:-38%. 
All differences were significant (p < .05) except XI-X2 and L-R. 
Evidently, sequences "derived according to. the program so that 
step sizes are uni^^mly ismall lead to . si gnif icantly better per- 
formance than ^dp random or learner-controlled sequences. Also, 
subjects must have'^^xr^ed previously derived rules in generating 
solutions to later problems, otherwise all groups would . have per- 
formed similarly. - 

. Mean times to solution on problems commcn to groups XI; '.and- 



: *5.. Procedures^ Subjects were individually • given problems 
one at a time (except . group L after problem 6> on separate «p.ages. 
For each problem;, the, problem statement was read aloud by. the ex- 
perimenter, given element^ were pointed out, r^elational termij 
weri5 explained,, an.d^ a sketch of the ''gbal figure^' in required re- 
lations to given elements was- drawn. Subjects perfofmed all^con- 
s£ructions on the problem pages. .- If a problem was f ai led,( . th^e 
subject was shown a solution rule for it, and. was required to~lBX- 
ecute the rule correctly on the problem page. Subjects rfjtained 
their problem pages through their sequences for memory support of 
previously derived solution ruias. Problems I through 6 were 
used to pretest . subjects^^ prior knowledges All subjects were in- 
itially given problem 6^" no subject '.solved it. Subjects were 
then given problems I through 6^ and .a 11 - sub jects solved problems 
I throu^ 6. These results supported the assumption that basic 
rules were at an appropriate level of detail. 
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X2 were in complete agreenient with predictions , from the Struc- 
tural Learning Theory. The only significant di if f ere^nces (in mean 
loq solution' times) * across X I and .X2' occurred in predicted direc- 
tions on problems 9 (XKX?),* 1 3 .( X KX2) , and 1 8 ;( X2<X I ) These 
differences clear ly track the step size differences ^of problems, 
and therefore provide .strong additional support for the viability 
. - of a goal-switchilng type of control mechanism. Also,.. X2 subjects 
were evident ly able to . retain and use ' hi gher -orde'r rules derived 
on some problems for Later problems even though, they were, not 
given memory support for higher order rules. 

As expected, a significant positiva. aissocia.tion between step 
size and frequency of failure occurred over the experiment.' No 
subject solved a problem when the step, size was greater than, 
three. Perhaps "memory load" approaches subjects^ processing 
capacities at step sizes around ;Thr^ee , and if so,, this might pro- 

-vd'd^ ~a' ^mor.e appropriate constraint on the program^s performance 

' than simply imposing a goal limit. *6 

However, a sionif icant step, size (2 or 3) by sequence condi- 
tion interaction on. percent success scores 'also occurred, such 
that L, and' parti cularl.y R subjects performed differentially more 
poorly' on stpp-size-three problems than did the XI or. X 2 sub- 
jects. Whi le . other- factors ( e. g. motivation) may be involved, 
- the Xr and .X2 sequences haye a "chaining" property such that^ 
problems'' solution rules are-. often* derived using.' rules from 

recent previous problems.. This was less often the case in the L 

~ancr~R~3'e~qu e iTC-es-j — Gh a-i-n-i-n-Q-i^si^dnl v i r.d i r e c 1 1 v related to con- 
trolled step, size: when a^ relatively sma TT~""5et~o~f^p rp b 1 e m s^i-s- 
given to . the program to be sequenced, the restrictions on goal 
.' ' levei force a moderate. degr.ee of chaining.- On thje other ^hand, if 
a. larger set of problerfis, including many different al te.iSinati ve 
intermediate problems bletween "basic" arid terminal . ones, were 
g.i^veh to the program," controlled step size would not necessarily 
' . force much chaining. To the extent the ru le .. -"recency"*, or 
ei n;7t°e 1 Umg are involved in subjects/ memorial " proce^sses, it may, 
be desirable to include additional assumptions concerning memory 
mechanisms. ' . ^ • 

'There was a fairly wide range over group L subjects of suc- 
"^r^s cess on chosen problems; Some L subjects had explicit bases for 
• ) choosing, "next"' problems, which seemed related ,to the step, sizes 
^■y^ , of chosen problems, and to success on "problems s Three subjects 
^ -who stated that they chose on the b^rls of similarity (of problem 
, statement and display.) to previous problems, chose chained prob-. 
. . le.ms of small step size ( most of ten tv/o) and solved about. 73%/of 
these. . However,' two. subjects, / Whr^. chose *"diss.imi lar" problems, 

^ *6. Determining memory load involves considering goal . lev- 
els, and numbers of rules involved 'at di fferent levels, but also 
. the loads imposed by pa.rticiilar rules during their execution. 
See Scandura (1.973; in press). 

- - ' ■ • . ■ • : 8 • • • 
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-never chose problems with, step sizes as sniall .as two^ and so, 
none of th'Mr chosen problems. The , remaining subjects indicated 
no particular basis for selection, and salved", about half their 
chosen problems. These results^ * arid others (e,.g., Pask and Scott, 
1971) suggest. that some subjects may have useful problem selec- 
tion' skills (rules), toward which additiona^l research might be 
directed. 
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Figure 1.:, Problem Solving and Learning Mechanism? 

. *■ ■ • ,' ■ ■. ■ . ', „ 

' • - ■ ■ ■ : ' . ■ ■. *' • 



START I S=Giyehs, G=initial goal. 
CG (current goal index) = JL. 
GLIMIT'= prespecified goal limit, 
jrules) set of available irules. 



i 



, 1. Is ;there a rule r €. '{rules} 
, to satisfy G? i.e. 3 r £ £^:ules| - 
such that G C Range<r)-, and there are\no 
XjL, . . . ,Xi'e S U {rules} such that 



(xi, . . . , £ t>omain(r) ? 
\ yes 



Apply r Jbo .(-xj;,ri ; .x-) : 

" . ■ ' ■'• ■ ■ 

3. If output of r xa 

a new rule r*., 

{rules} <= {rules} U r». 



I 




2, CG <= CG + i.- 
G <= higher level 
goal- = •H(G) 



CG > .1? 



C 



I 




no 



yes 



CG <= CG - 1L.\ ' 
Jjt <= previous goal 

t 



SUCCESS 
EXIT 



\ 




5» . 
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^Fi^^vtre^^A * * Overall Program .Operation 




Load Kulc=: Set yith (Domain, Range) V sind 
prqcedifre* fpr each- initial rilie, 

Xliitiali^e system- * > . .1 
Read FLIMIT (fariiure limit),. \ 
Read GLIMIT (goal, limit) . ' / 



Are there. m'ofe'v^ 
problems 01 
.\ list?' 



np /' AVe there more 
\ problems . dh failed • 
\ problem* list?- 



no 



yes C 



obtain . and «~remove 
f irstv problem ^on 
input list. . - 




» . • . . 
obtair* and remove?" 
first problem on • . 
failed problem list* 






1 ^ --^ % 



Execute problem 
solving -i* learning 1 
mechanisn^* 



\ Fail 



Is the number of 
C failed ^problems 
\> FLIMIT? 



yes 




Save failed problem 
on failed problem 
list. 
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